Can knowledgeable experts assess costs and outcomes as if they were ignorant? An experiment within precision medicine evaluation.

OBJECTIVES: The purpose of this study is to evaluate the validity of the standard approach in expert judgment for evaluating precision medicines, in which experts are required to estimate outcomes as if they did not have access to diagnostic information, whereas in fact, they do. METHODS: Fourteen clinicians participated in an expert judgment task to estimate the cost and medical outcomes of the use of exome sequencing in pediatric patients with intractable epilepsy in Thailand. Experts were randomly assigned to either an "unblind" or "blind" group; the former was provided with the exome sequencing results for each patient case prior to the judgment task, whereas the latter was not provided with the exome sequencing results. Both groups were asked to estimate the outcomes for the counterfactual scenario, in which patients had not been tested by exome sequencing. RESULTS: Our study did not show significant results, possibly due to the small sample size of both participants and case studies. CONCLUSIONS: A comparison of the unblind and blind approach did not show conclusive evidence that there is a difference in outcomes. However, until further evidence suggests otherwise, we recommend the blind approach as preferable when using expert judgment to evaluate precision medicines because this approach is more representative of the counterfactual scenario than the unblind approach.

Using an experiment among clinical experts to determine the cost and clinical impact of rapid whole exome sequencing in acute pediatric settings.

Objective: Evaluate the cost and clinical impacts of rapid whole-exome sequencing (rWES) for managing pediatric patients with unknown etiologies of critical illnesses through an expert elicitation experiment. Method: Physicians in the intervention group (n = 10) could order rWES to complete three real-world case studies, while physicians in the control group (n = 8) could not. Costs and health outcomes between and within groups were compared. Results: The cost incurred in the intervention group was consistently higher than the control by 60,000-70,000 THB. Fewer other investigation costs were incurred when rWES could provide a diagnosis. Less cost was incurred when an rWES that could lead to a change in management was ordered earlier. Diagnostic accuracy and the quality of non-pharmaceutical interventions were superior when rWES was available. Conclusion: In acute pediatric settings, rWES offered clinical benefits at the average cost of 60,000-70,000 THB. Whether this test is cost-effective warrants further investigations. Several challenges, including cost and ethical concerns for assessing high-cost technology for rare diseases in resource-limited settings, were potentially overcome by our study design using expert elicitation methods.

Which interventions for alcohol use should be included in a universal healthcare benefit package? An umbrella review of targeted interventions to address harmful drinking and dependence.

BACKGROUND: This study aimed to identify targeted interventions for the prevention and treatment of harmful alcohol use. Umbrella review methodology was used to summarise the effectiveness across a broad range of interventions, in order to identify which interventions should be considered for inclusion within universal health coverage schemes in low- and middle-income countries. METHODS AND FINDINGS: We included systematic reviews with meta-analysis of randomised controlled trials (RCTs) on targeted interventions addressing alcohol use in harmful drinkers or individuals with alcohol use disorder. We only included outcomes related to alcohol consumption, heavy drinking, binge drinking, abstinence, or alcohol-attributable accident, injury, morbidity or mortality. PubMed, Embase, PsycINFO, Cochrane Database of Systematic Reviews, and the International HTA Database were searched from inception to 3 September 2021. Risk of bias of reviews was assessed using the AMSTAR2 tool. After reviewing the abstracts of 9,167 articles, results were summarised narratively and certainty in the body of evidence for each intervention was assessed using GRADE. In total, 86 studies met the inclusion criteria, of which the majority reported outcomes for brief intervention (30 studies) or pharmacological interventions (29 studies). Overall, methodological quality of included studies was low. CONCLUSIONS: For harmful drinking, brief interventions, cognitive behavioural therapy, and motivational interviewing showed a small effect, whereas mentoring in adolescents and children may have a significant long-term effect. For alcohol use disorder, social network approaches and acamprosate showed evidence of a significant and durable effect. More evidence is required on the effectiveness of gamma-hydroxybutyric acid (GHB), nalmefene, and quetiapine, as well as optimal combinations of pharmacological and psychosocial interventions. As an umbrella review, we were unable to identify the extent to which variation between studies stemmed from differences in intervention delivery or variation between country contexts. Further research is required on applicability of findings across settings and best practice for implementation. Funded by the Thai Health Promotion Foundation, grant number 61-00-1812.